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METHOD AND APPARATUS FOR VISUALIZATION OF 3D 
VOXEL DATA USING LIT OPACITY VOLUMES WITH SHADING 



This application is a utility patent application of a prior pending provisional 
application Ser. No. 60/256,433, filed December 18, 2000, entitled "Visualization of 3d 
Geoscience Data Using Lit Opacity Volumes With Shading". 



This invention relates generally to the field of computer graphics. Particularly, 
this invention relates to volume rendering. More particularly, this invention relates to the 
display of three-dimensional (3D) data on a two-dimensional (2D) display with shading 
and opacity to control tKe realistic display of volumetric data in voxel format. 



Volume rendering is an important area of computer graphics. It is employed in a 
wide variety of disciplines, including medicine, geology, biology and meteorology. 
Volume rendering allows a user to look inside an object and see features that were 
otherwise shielded by the rendering of the surface features of the object. One patent 
teaching volume rendering using voxels is U.S. Patent No. 6,304,266, issued October 16, 
2001, entitled "Method and Apparatus For Volume Rendering" which is incorporated 
herein by reference. 

In Fig- 1 volumetric data is shown as consisting of a three-dimensional (3D) 
dataset of elements called "voxels" 102. Typically, the voxels 102 are uniformly 
distributed throughout a volume 104. Each voxel 102 has a position in the volume and 
has associated with it information such as color, illumination, opacity, velocity. 



Cross Reference to Related Applications 



Field of the Invention 



Background of the Invention 
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amplitude, etc. The information associated with each voxel 102 is produced by such 
disciplines as medicine (e.g., CAT scans), biology (confocal microscopy), and geoscience 
(seismic data). 

In Fig. 2 is shown how data values of voxels 102 are typically stored in a storage 
array 202. The position of a particular voxel in the volume is inherent in its location in 
the array. For example, array position 204 might be associated with a point 106 (Fig. 1) 
in the volume that is a specified distance from a specified comer of the volume. 
Typically, a single value is stored in the array 202 for each voxel 102, although it is also 
possible to store more than one value for each voxel 102, such as for color, illumination, 
opacity, velocity and amplitude. 

Figs. 3, 4, and 5 show 2D texture rendering subdividing volumetric data into 
slices. 2D texture rendering organizes the slices into three sets of slices 302, 402 and 502 
along three different orthogonal axes. The voxels are partitioned among the sets of slices 
302, 402 and 502 and into cells containing multiple voxels in each slice. The partitioning 
is done based on the position of the voxels in array 202. In a similar fashion, 3D texture 
rendering typically slices the volume perpendicular to the viewing direction. 

The rendering is then accomplished on a slice-by-slice basis, moving from the 
rear-most slice 304, 404 and 504, respectively, to the front-most slice 306, 406 and 506 
respectively. The set of slices that is chosen and processed is the set whose axis makes 
the smallest angle to the viewing direction. While a new image is rendered it is blended 
with the previously drawn scene, creating perception of a 3D body. 2D texture rendering 
organizes the slices along one of the three volume dimensions, while 3D texture 
rendering slices the volume perpendicular to the viewing direction, which improves 
image quality, but requires interpolation between the volume data points. Such 
interpolation is usually performed by specialized graphics hardware. 
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Figs. 6 and 7 show how texture value, or "texel is determined for each voxel in 
each slice (blocks 702 and 704). The texels are stored in a data buffer 602 (block 706). 
Typically, the texel value is an indication of the RGB colors (red, green & blue) to be 
displayed for a voxel as determined by one or more parameters dependent on the data 
value or values associated with the voxel and is found in a look-up table. For example, 
the texel data may include a value for each of the red, green, and blue (RGB) components 
associated with the voxel. When all of the voxels in the slice have been processed (block 
704), the contents of the data buffer are downloaded into a texture memory 604 (block 
708). 

Fig. 8 shows a display device 802 upon which information downloaded with the 
texel data is displayed. Based on that information and the perspective requested by the 
user, the display device maps the texels onto pixels on a display screen 804 (block 710). 
As each slice is downloaded and rendered, the user sees the volume in the requested 
perspective. Each time the user changes the view, for example by using a software tool 
to rotate, translate or magnify the image of the volume, the process of downloading and 
rendering slices is repeated. 

In Fig. 9 is illustrated the display of a volume that shows the outside surfaces of 
the volume. The interior of the volume is not seen. 

In some applications, greater flexibility is achieved by using semi-transparent 
data. Semi-transparent data is created by adding an additional factor, alpha (a), to each 
voxel along with the RGB (red, green & blue) components described above. The value 
of alpha of a voxel determines the opacity of the voxel. Opacity is a measure of the 
amount a particular voxel on a slice will allow a voxel on a background slice that maps to 
the same pixel on a 2D display to show through. The opacity of a voxel controls how the 
image of the voxel is blended with the images of the voxels behind it in the view being 
displayed. An opacity value of 0.0 means a voxel is completely transparent and cannot 
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be seen so has no effect on the color of the displayed pixel on the 2D display since it is 
considered to be empty; and a value of 1.0 means the voxel is completely opaque, may be 
considered solid and, if it has no other voxels mapped in front of it, its texel determines 
the color of the displayed pixel. Intermediate opacity values correspond to intermediate 
levels of opacity, and the texel defined colors of two voxels mapped to the same pixel are 
mixed in conventional ways to determine the color of the pixel that will be displayed. 

In Fig 10 is illustrated an opacity tool, such as the one included in the GEO VIZ 
product from Schlumberger-GeoQuest, the assignee of the present invention. The 
opacity tool is used to map volumetric data, such as geophysical seismic interpretation, 
magnetic imaging, and ultra-sonography data, to see semi-transparent volumetric data 
therein. In those cases, the value of each voxel is not only mapped to a color defined by 
its texel but also with an opacity defined by alpha (a). In Fig. 10, the user has adjusted 
the opacity mapping, shown graphically by curve 1002, to make transparent all voxels 
(alpha = 0) except those having large positive or negative values. This has the effect of 
making most of the data transparent when displayed, as can be seen from the histogram 
1004 that reflects the distribution of the values of the voxels in the volumetric data 
displayed in Fig. 9. This is a technique called "standard opacity volume rendering" and 
allows a user to make voxels within a selected range of data values invisible, while 
leaving other voxels visible. 

In Fig. 11 is shown a display that results when the data displayed in Fig. 9 is 
processed using the opacity tool shown in Fig. 10. The surface of the volume no longer 
obscures structures inside the volume as is evident when comparing Figs. 9 and 1 1. 

It is also apparent from the histogram 1004 and Fig. 1 1 that most of the opacity- 
adjusted voxels are transparent and have no effect on the display. 
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Summary of the Invention 



The invention is concerned with improving the visual quality of images produced 
by rendering volumetric data in voxel format for the display of three-dimensional (3D) 
data on a two-dimensional (2D) display with shading and opacity to control the realistic 
display of images rendered from the voxels. 

One of the main shortcomings of standard opacity volume rendering of the voxel 
format data volumes described in the Background of the Invention is that objects 
displayed using a voxel data volume appear flat, which inhibits depth perception and 
makes it hard, if not impossible, to determine the 3D shape, orientation, and relative 
positions of the objects. 

Figure 12 shows the display of an elliptical object rendered using standard opacity 
volume rendering of volumetric data consisting of voxels. Although it is clear that the 
cross-sectional shape is oval, there is no way to tell if the object is elliptical, ovoid, 
conical, etc. It is also impossible to tell if the object touches the flat seismic section 
behind it. The reason for these shortcomings is that traditional computer graphics 
surface lighting techniques do not work for voxels because the individual voxels have no 
proper surfaces to be lit. 

Figure 13 shows how an elliptical set of voxels will appear when displayed as a 
set of solid "bricks" lit with a light. The actual shape of the rendered object can now be 
seen. 

In an attempt to alleviate the shortcomings with rendering and displaying voxels, 
the viewer makes elaborate adjustments to the volume color map or the opacity values, 
watches the rendering progressing from back to front, moves the viewpoint or simply 
employs the imagination to help recreate the objects in his or her mind. The methods are 
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very time-consuming, subjective and difficult for an inexperienced viewer to master, and 
they all yield unsatisfactory results. 

To overcome these shortcomings the invention illuminates a voxel volume with 
one or more light sources. When rendered and displayed the lighted volume offers the 
viewer ample visual information to aid in the perception of depth, as well as the shapes, 
orientations, and positions of objects in the voxel volume. Lighting parameters are 
computed, and graphical attributes of individual voxels are adjusted based on the 
orientation of opacity isosurfaces passing through each voxel in the volume. 

To improve the display of objects the opacity of displayed voxels of a data 
volume may be adjusted depending upon the opacity of nearby voxels. Using an opacity 
tool each voxel in a volume is assigned a standard opacity value a using a 3-dimentional 
opacity function a{ij,k) where alpha represents opacity and the letters ij,k represent 
orthogonal directions. 

Isosurfaces connect voxels with equal opacity values. For each voxel, the 
algorithm estimates a normal to the isosurface passing though the voxel, which is equal to 
the negative gradient of the opacity function at the voxel, and uses it to shade the voxel as 
if it were a point on the isosurface. Though results are typically shown for a single uni- 
directional white light source, the results can be easily extended to bi-directional light 
sources or colored lights. 

In Fig. 14 are shown the basic steps implemented in the rendering process that 
includes the teaching of the present invention, and these steps are generally described 
immediately below. The invention is implemented only in the second and third steps, in 
blocks 1402, 1403 and 1404. 
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At block 1401, the initial opacity value of each voxel in the input voxel data 
volume is processed with an opacity tool, such shown in Fig. 10, to make most of the data 
transparent when displayed, as previously described, and the structures inside the volume 
are no longer obscured as can be seen in Fig. 11. As part of this process the initial 
opacity value for each visible voxel in the data volume is converted to a standard opacity 
(a) value. 

At block 1402, the standard opacity value a for each visible voxel is converted to 
a new "visible opacity" p value in accordance vsdth the teaching of the present invention. 

At block 1403, a new visible gradient value is calculated for every visible voxel in 
a volume using the new visible opacity p values in accordance with the teaching of the 
present invention. The new visible gradient value calculated for each voxel accounts for 
degenerate cases in numeric gradient computation and are used in all further rendering 
computations. Only visible cells, selected using the opacity tool and having a new visible 
opacity p calculated, have their opacity P value used to compute a new visible gradient, 
G , for each voxel. The new visible gradient, G , for each voxel are used to shade and 
render the displayed voxels. 

At block 1404, ambient and diffuse shading is computed that would be applied to 
an opacity isosurface passing through the voxels in an ambient and diffuse illumination 
model wherein the voxel volume is illuminated with one or more light sources (typically 
directional and bi-directional). The direction of the negative visible gradient vector 
G serves as a normal to the isosurface. Special treatment is added for voxels inside 
opaque areas of the volume based on specifics of volumetric geoscience data, which 
improves a user's perception of the rendered image. A lighted and shaded volume offers 
the viewer ample visual information to aid in the perception of depth, as well as the 
shapes, orientations, and positions of objects in the volume. 
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At block 1405, for both 2D and 3D textures, the colors of all visible voxels in the 
volume are modified by applying the shading computed in block 1404. 

At block 1406 the processed, visible, voxel data volume, with shading, is 
displayed. 

In one aspect of the invention, a computer is used to process voxel volume data, 
and the invention comprises an article of manufacture comprising a medium that is 
readable by the computer and the medium carries instructions for the computer to 
perform the novel process of calculating the new visible opacity and the visible gradient 
for each voxel as described in the previous paragraphs. 

Brief Description of the Drawings 

The invention will be better understood upon reading the following Description of 
the Preferred Embodiment in conjunction with the drawings in which: 

Fig. 1 is a representation of voxels within a cubic volume; 

Fig. 2 is a representation of the storage of voxel values in a memory; 

Figs. 3-5 illustrate the partitioning of a volume into slices in orthogonal planes for 
2D texture rendering; 

Fig. 6 is a representation of a volume rendered image without shading; 

Fig. 7 is a block diagram of the steps in a volume rendering process; 

Fig. 8 is a block diagram of volume rendering equipment; 

Fig. 9 is a rendering of an opaque volume; 

Fig. 10 is a representation of an opacity tool; 

Fig. 1 1 is a rendering of a semi-transparent volume after an opaque volume is 
processed using an opacity tool; 

Fig. 12 shows the display of an elliptical object rendered using standard opacity 
volume rendering of volumetric data consisting of voxels without shading; 
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Fig 13 shows how an elliptical set of voxels would appear when displayed as a set 
of solid "bricks" lit with a light; 

Fig. 14 shows in block diagram form the steps of processing and displaying 
volumetric geoscience data consisting of a volume of voxel data; 
5 Figs. 15 - 17 are exploded views of volumes each showing a cell made up of 

voxels that is used to calculate new visual opacity and visual gradient values for voxels; 

Figs. 18- 20 are tables showing how the new visual opacity values for voxels are 
calculated; and 

Figs. 21 - 23 are tables showing how the new visual opacity values are used to 
10 calculate new visual gradient values for voxels. 

O 

12 Description of the Preferred Embodiment 



In the following description all reference numbers indicate in which Figure they 
15 are located. Thus, for example, reference number 1004 is found in Fig. 10, and reference 



m 

P 

8 number 1405 is found in Fig. 14. 

fU 

Volumetric data volume is first partitioned into slices as illustrated in Figs. 3, 4 
P and 5, and the slices each contain rows and columns of voxels, not seen in these Figures 



20 but seen in Figures 15-17. Volume rendering of the data may be speeded by reducing 
the number of voxels that are processed, downloaded and rendered by eliminating 
transparent voxels. Such volume rendering is taught in the previously mentioned U.S. 
Patent No. 6,304,266 that is incorporated herein by reference. 

25 In Figs. 15 - 17 are shown a representative volume of voxels formed into a 

plurality of slices A - E and cells, as particularly applied to geoscience data, voxels are 
grouped into cells containing no fewer than twenty-seven alpha-numeric designated 
voxels (eg. Al 1, C21) and forming a cube. Other undesignated voxels shown in these 
Figures are other voxels of the data volume in which the cells being described are 
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located. Only one cell is shown in each of these Figures for simplicity, but in reality 
there would be many slices and many cells in each slice of a volume. These cells are 
described in greater detail hereinafter. The slices are shown separated from each other 
only for ease in seeing the twenty-seven voxels Al 1-A33, Bl 1-B33 and CI 1-C33 that 
make up cells one and three in Figs. 16 and 17 respectively, and the twenty-seven voxels 
B11-B33, C11-C33 and D11-D33 that make up cell two in Fig, 16. 

For the purposes of this example, only horizontal slices are specifically shown in 
Figs. 15, 16 and 17 but there are also vertical slices, and the intersecting orthogonal slices 
through the data volume are used to create the three dimensional rows and columns of 
voxels, as shown, so that, in this particular case, the vector / arrow direction of the light 
source is parallel to one of the three orthogonal axes (u,v,w) of the sliced data volume 
while the other two axes are orthogonal to the direction of the light source vector. In 
Figs. 15 and 16 the light vector is parallel to axes W, and in Fig. 17 the light vector is 
parallel to axes V. Note that while the illustrations show the light direction parallel to 
one of the axes, the method employed supports arbitrary directions for the light source. 
The value of initial opacity, a, for the voxels in each cell are used to calculate the values 
of visible opacity p only for the voxels in each cell as described hereinafter with 
reference to Figs. 18-20. 

While the preferred cell size, as shown in Figs. 15-17, is twenty-seven voxels 
forming a cube of 3x3x3 voxels, a different cell partitioning size might be appropriate for 
other data, such as medical or meteorological data. An example of another cell size may 
be one-hundred, twenty-five voxels forming a cube of 5x5x5 voxels. The number of 
voxels in a cell is based on the distribution of data in the volume. 

In Fig. 15 cell one the particular voxel of interest is the center voxel B22. In Fig. 
15 light is incident on the top of the data volume and cell one and is represented by the 
light source vector / arrow. In Fig. 16 cell two the particular voxel of interest is the center 
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voxel C22. In Fig. 16 light is incident on the top of the data volume and cell two and is 
represented by the light source vector / arrow. In Fig. 17 cell three is made up of the 
same voxels as cell one, but light is incident on the right side of the data volume and cell 
three as represented by the light source vector / arrow. 

As briefly described above, the initial opacity value for each voxel in a data 
volume is first mapped with an opacity tool, such as the one illustrated in Fig. 10 and that 
is included in the GEO VIZ product of Schlumberger-GeoQuest, to obtain a "standard 
opacity" value a for each voxel in a data volume. The opacity tool adjusts the opacity 
mapping of voxels in the data volume to make transparent chosen voxels (a = 0) except, 
for example, those having large positive or negative values. This has the effect of 
making most of the data transparent when rendered, and structures inside the data volume 
are no longer obscured as can be seen in Fig. 11. This is a technique called "standard 
opacity volume rendering" and allows a user to make voxels within a selected range of 
data values invisible, while leaving others visible. The operator does this by changing the 
setting of the opacity tool. This technique is described in greater detail in U.S. Patent No. 
6,304,266 cited above. 

In a simplified treatment of visibility we, first, find the largest component of the 
light incident on a data volume and mark it as the "visibility direction" (e.g., u, assuming 
that L„ =max(L„,L,,L^)). This would be the vector / arrow in Figs. 15-17. Thus, for 
a light coming from the u direction (not represented in Figs. 15 - 17), the new "visible 
opacity" P value is computed using the following equations: 
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/i(i-ljjk) = a(i-l,j\k) 

J3(i + lyj.k) = mfix{fiiiJ,k)Mi + IJ^k)) 



else 



J3ii + lJ,k) = a(i^lJ,k) 

J3(hj\k) = max(/?(i + l,j\k)Mi,j\k)) 



The above mathematical equations are used to calculate the visible opacity p for 
each voxel in each of the nine columns of three voxels in a cell, as viewed from the 
direction of the light, such as voxel column All, Bll, CU and voxel column A23, B23, 
C23 in cell one. When a voxel column is viewed from the direction of the light source, if 
the first voxel is opaque all other voxels behind it cannot be seen. For example, in cell 
one in Fig. 15, if voxel Al 1 is opaque, voxels Bll and CI 1 behind it cannot be seen. 
Similarly, if voxel All is semi-transparent (initial opacity value between 0.0 and 1.0) the 
opacity value of voxels Bll and CI 1 behind voxel All cannot be any less. For example, 
if voxel Al 1 is semi-transparent with an opacity value of 0.7, voxels Bll and CI 1 cannot 
have a visible opacity value any lower than 0.7 and are changed accordingly in 
calculating visible opacity values P for voxels Bl 1 and CI 1. 

Figs. 18 - 20 are tables used to simplify and more clearly show the mathematical 
calculations performed by the above equations to derive the new visible opacity values p, 
respectively, for all twenty-seven voxels in each of cells one, two and three using the 
"standard opacity" value a of the voxels in accordance with the teaching of the present 
invention. In the following description, "a" indicates standard opacity and when used as 
aAl 1 indicates the standard opacity of voxel All, and "P" indicates the new visible 
opacity and when used as PAI 1 indicates the visible opacity of voxel Al 1. 
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Return to Fig. 15 to describe calculating visible opacity p values for all voxels in 
cell one as shown in the table in Fig. 18. With light being incident on the top of the 
volume in Fig. 15, and the Al 1-A33 voxels being on the top of the cell, the standard 
opacity value of each of the voxels A11-A33 (aAl 1 - aA33) is equal to the visible 
5 opacity (3 value of each of these voxels. There is nothing in front of these voxels to block 
or alter the intensity of the light shining upon them, so their standard opacity will equal 
their visible opacity. This is represented in the "A slice" column in Fig. 18 as 
aAl l=pAl 1, aA12=PA12 etc. through aA33=pA33. 



10 To calculate the visible opacity P of voxel Bll behind voxel Al 1, and with 

standard opacity of voxel Al 1 (aAl 1) equal to the visible opacity PAl 1 of voxel All, 

P 

P when PAl 1 is greater than the standard opacity of voxel Bl 1 (aBl 1) behind it, then the 

value of visible opacity of voxel Bll (pBl 1) cannot be any smaller and is changed to 
p equal the visible opacity of voxel All. That is, the visible opacity of voxel Bl 1, PBl 1, is 
P 15 set equal to the visible opacity value of voxel All, pAl 1 (PBl 1 = pAl 1). Conversely, if 
^ the visible opacity PAl 1 is less than or equal to the standard opacity aBl 1, then the 
visible opacity of voxel Bl 1, PBl 1, is set equal to its standard opacity value (PBl 1 = 
aBll). Continuing down the same column of voxels All, Bll and Cll to the Cll 
voxel, and again using the same rationale, if the visible opacity of voxel Bll, PBl 1, is 
20 greater than the standard opacity of voxel CI 1 aCl 1, then the visible opacity of voxel 
Cll, pen, is set equal to the visible opacity of voxel Bll, PBll (PCll = PBll). 
Conversely, if the visible opacity of voxel Bll, PBll, is less than or equal to the standard 
opacity of voxel CI 1, aCl 1, then the visible opacity PCII remains equal to its standard 
opacity (pCll =aCll). 



m 

P 



25 



This same detennination of visible opacity for all voxels in cell one is repeated for 
each of the other of the nine columns of three voxels in Fig. 15 (e.g. voxel columns A32, 
B32 & C32; A22, B22 & C22; etc.). The visible opacity P values calculated in this 
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manner for all voxels in cell one are used for the sole purpose of calculating the visual 
opacity gradient for only voxel B22 in the center of cell one as is described hereinafter 
with reference to Fig. 21. Although other cells, such as cell two, include many of the 
same voxels included in cell one, the values of visual opacity will be recalculated for all 
voxels in each cell, and the visual opacity values for voxels in cell two most likely may 
be different than those values calculated when the voxels are in cell one. 

Although only one cell is shown in Fig. 15 there are in reality many cells in a data 
volume and the visible opacity 3 is determined for all voxels in the data volume. This is 
done by having each voxel at the center of a cell and performing the calculations 
described above. The voxels on the outer surface of the volume can be disregarded. 

In Fig. 19 is a table showing how standard opacity a values of each of the voxels 
in cell two (Fig. 16) are used to obtain the new visible opacity P values for each of the 
voxels in cell two. With light being incident on the top of the data volume in Fig. 16, 
and the B11-B33 voxels of cell two being on the side of the cell from which the light is 
coming, the standard opacity value of each of the voxels B11-B33 is equal to the visible 
opacity value of each of these same voxels. This is represented in the "B slice" column 
in Fig. 19 as aBl 1=PB1 1, aB12=pB12 etc. through aB33=PB33. 

When calculating the visible opacity of voxel CI 1 behind voxel Bl 1, and using 
the rationale described in previous paragraphs, if the visible opacity PBll is greater than 
the standard opacity a of voxel CI 1, then the visible opacity of voxel Cll is changed to 
equal the visible opacity of voxel Bl 1. That is pCl 1 = PBl 1. Conversely, if the visible 
opacity of voxel Bll, pBU, is less than or equal to the standard opacity of voxel Cll, 
aCl 1, then the visible opacity PCI 1 of voxel Cll is set equal to its standard opacity. 
That is PCI 1 = aCl 1 . Continuing down the column of voxels Bl 1, CI 1 and Dl 1, if the 
visible opacity of voxel Cll, pC 11, is greater than the standard opacity of voxel Dll 
aDl 1, then the visible opacity of voxel Dl 1, pDl 1, is set equal to the visible opacity of 
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voxel Cll, pen. That is ^Dll = |3C11. Conversely, if the visible opacity of voxel 
CI l,pCl 1, is less than or equal to the standard opacity of voxel Dl 1, aDl 1, then the 
visible opacity POU remains equal to its standard opacity aDlL That is pDl 1 = aDl L 

This same calculation of visible opacity P for all voxels in cell two is repeated for 
each of the other nine columns of three voxels in cell two in Fig. 19 (e.g. voxel columns 
B32, C32 & D32; B22, C22 & D22; etc.). In this manner the visible opacity p of all 
voxels in cell two is calculated. The calculated value of visible opacity P for all voxels in 
cell two are only used in the equations in Fig. 22 to calculate the visible opacity gradient 
P of voxel C22 in the center of cell two. 

Although only one cell is shown in Fig. 16 there are in reality many cells in a data 
volume and the visible opacity P is determined for all voxels in the data volume. This is 
done by having each voxel at the center of a cell and performing the calculations 
described above. The voxels on the outer surface of the volume can be disregarded. 

In Fig. 17 is cell three that has the same voxels as cell one shown as in Fig. 15 but 
the direction of light on the data volume and cell three is from the right side, rather than 
from the top. Accordingly, calculations for visible opacity p are identical in manner but 
are different. The columns of three voxels are on their side through cell three. For 
example, voxels B23, B22, B21 and voxels C13, C12, Cll. The tables for calculating 
visible opacity p for all voxels in cell two are shown in Fig. 20. In view of the previous 
description of how these calculations are made with reference to the tables in Figs. 18 and 
19, the description is not repeated here for the sake of brevity. The visible opacity P of 
all the voxels in cell three are used to calculate the visible opacity gradient G only for 
voxel B22 in the center of cell three as described hereinafter with reference to Fig. 23. 
Again, there are many cells in the data volume in Fig. 17 and visible opacity is 
determined for all voxels. 
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Figs. 21 - 23 are tables used to describe the mathematical calculations performed 
to derive the three gradient components G„ , , and that define a new visible 

opacity gradient G for only the voxel in the center of each of representative cells one, 
two and three in accordance with the teaching of the present invention. The gradients 
must be derived for all voxels in a data volume so similar tables are derived for the other 
voxels in a data volume, not just cells one, two and three. The three gradient components 
are calculated for every voxel using the newly calculated value of visible opacity P for all 
voxels in each cell. For cell one in Fig. 15 the center voxel is B22; for cell two in Fig. 16 
the center voxel is C22; and for cell three in Fig. 17 the center voxel is B22. The new 
visible opacity gradient G for all voxels are then used to render the voxel data volume in 
a manner well known in the art. These calculations are repeated for each voxel in a 
volume and are described in greater detail hereinafter. 

Return to cell one to describe how the visible opacity P values for each of the 
twenty-seven voxels in cell one are used to calculate the new visible opacity gradient G 
for center voxel B22. Using the visible opacity p values calculated for each of the 
twenty-seven voxels All through C33 in cell one, these values are used in the equations 
shown in Fig. 18 to calculate vector components G„ ,G^ andG^ of vector G only for 
voxel B22 in the center of cell one. The vector components are then combined to get 
vector G , the negative visible opacity gradient for voxel B22. 

In the same manner, the new visible opacity P values calculated for each of the 
twenty-seven voxels BU through D33 in cell two are used in the equations in Fig. 19 to 
calculate gradient components G„ ,Gy andG^ of the visible opacity gradient vector 

G only for voxel B22 in the middle of cell two. The gradient components are then 
combined to get the negative visible opacity gradient for voxel B22. 
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Also, the visible opacity p values for the twenty-seven voxels All through C33 in 
cell three are used in the equations in Fig. 20 to calculate vector components 
G„ andG^ of the visible opacity gradient vector G only for voxel C22. The gradient 
components are then combined to get the negative visible opacity gradient for voxel C22. 
5 The basic gradient equations are known in the prior part and are described in more detail 
in the following paragraphs, but values of visible opacity P are used in the equations 
rather than values of standard opacity as previously used to derive the simplified 
calculations shown in Figs. 21-23. 

( , 10 A negative opacity gradient, G , at a particular voxel is determined by three 

Q partial derivatives along the three major axes, G„ , G^ , and G^ as: 

G={-G„-G,,-G,> 

l>n where the standard gradient equations used are: 

O G„ =Y,ce(i+lJ,k)-Y,cc(i-lJ,k) 

^ JJc j.k 

K ='Z''(iJ + hk)-Y,cc(iJ-l,k) 

\¥ i,k i,k 

% G,=Y,cc(iJ,k+l)-Y,cc(iJ,k-l) 

l?"^ 15 However, in accordance with the teaching of the invention, these three standard 

gradient equations for calculating vector components G„ , G^ andG^ are modified to 

calculate a new negative "visible opacity gradient" vector G , shown in the following the 
equations, by using the new visible opacity (3 values, rather than standard opacity values 
a shown in the equations immediately above. Substituting a value of visible opacity p in 
20 the standard gradient equations, the gradient equations then become: 

j,k j,k 
i,it i,k 

G,=Z^(hJ'k + l)-Yfi(hj,k-l) 
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• 



where fi(ij,k) are the visual opacity of a single voxel along each its three major axes ij\k. 

Only visible voxels, selected using the opacity tool, and then further processed to 
derive visible opacity P for each visible voxel, are used to compute vector components 
G„ , andG^ of negative visible opacity gradient G , preferably using the 26- 
neighborhood central difference method described above, at each visible voxel using the 
modified equations immediately above. The negative visible opacity gradient G is 
calculated using the equation: 



where the vector components G„ , andG^ are calculated using the tables in Figs. 21 - 
23. These tables reflect the calculations in the above gradient equations. 

Gradient G computed using the twenty-six neighborhood difference method have 
significantly more distinct values and result in smoother images than a six-neighborhood 
difference, although the latter is faster to compute but has only twenty-seven distinct 
values that result in abrupt changes of shading. For the present description we use the 
twenty-six neighborhood difference gradient of the opacity. These equations work 
regardless of the number of lights illuminating an object or the color of the light. 

The new visible opacity gradient, G , for each of voxels B22 (cell one), C22 (cell 
two) and B22 (cell three) are then used to calculate ambient and diffuse shading intensity 
for those voxels in a manner previously known, with the addition of special treatments 
provided by this invention, and generally described with reference to block 1404 in Fig. 
14. Shading is computed as if it were applied to an opacity isosurface passing through all 
voxels in a volume in an ambient and diffuse illumination model wherein the voxel 
volume is illuminated with one or more light sources (typically directional and bi- 
directional). The direction of the negative visible opacity gradient vector serves in this 
case as a normal to the isosurface. Special treatment is added for the voxels inside 
opaque areas of the volume based on specifics of volumetric geoscience data, which 
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improves a user's perception of the rendered image. A lighted and shaded volume offers 
the viewer ample visual information to aid in the perception of depth, as well as the 
shapes, orientations, and positions of objects in the volume. 

As part of computing shading a decision is made if the volume being rendered is 
to be shaded as if lit by a uni-directional light source pointing in one direction or by bi- 
directional light consisting of two identical directional lights pointing in opposite 
directions on a volume. When the volume being rendered is lit by a uni-directional 
source the ambient and diffuse shading intensity is calculated using opacity 
0/./u^. = /(/5) ) as follows: 

ifGL>0 

ishamng = l<muem + ^m^e " l)i Norm{G ) 
elseifG-L<0 

^shading ~ ^ambient 

where G is the negative visible opacity gradient, calculated as previously described, and 
L is the unit light vector. 

For bi-directional light consisting of two identical directional lights pointing in 
opposite directions on the volume, the ambient and diffuse shading intensity is calculated 
as follows: 

ifG'L>0 

I shading = lamtiem + ^d^use ' Norm(G ) 

elseifGL<0 

I shading = I ambient " ' diffuse ' NomiiQ ) 

where G is the vector of the negative visible opacity gradient and L is the unit light 
vector. 
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For the case of G = 0 (when and only when Norm(G ) = 0) deserves special 
treatment. There exist four possible scenarios: 

a) G = 0 and the opacity value in the voxel is 0.0 ( fiiij^k) = 0). We treat this 
5 case as an empty space and set I shading - ^ • 

b) G = 0 while the data value in the voxel is not 0.0 ( fi{hj\k) data values 
of the surrounding voxels are not all 0.0, and 



P 10 



a 

ru 

a 



5;y0(j+l,>,/:) = Xy^O".;+l,^) = Sy^O\y.^+i) 

jyk i,k ij 



In this case the voxel is treated as positioned within a homogeneous voxel body. 

^^1 Theoretically, in this case an isosurface that would pass through the voxel is not defined 

in 

P and, thus, the voxel should not be shaded ( I, fading = 1 )• This produces visual artifacts 



when somebody observes the rendered image. In order to eliminate it, we choose to 
15 assign such voxels an artificial gradient G^^^^^^^^ and set the shading intensity in such a 
voxel to be: 

M 

For most of 3D geoscience volumes there are horizontal layers in the data so the 
20 most reasonable choice for G^^^^^^^ is: 

G,refered={OAl) 

c) G=0 while the data value in the voxel is not 0.0 (fiiijjk) ^0), but data 
values of all the surrounding voxels are 0.0. In this case of a single voxel surrounded by 
25 empty space the direction of the visual opacity gradient in not defined. Thus, we 
arbitrary select it to satisfy the equations from scenario (b) inraiediately above. 
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d) The rest of the scenarios might require re-computing G by using right 
differences or some other known method. The required computations are time 
consuming. The shading computed using the formula in scenario (b) above for most 
voxels approximates the precisely computed ones reasonably well. 

After the shading intensity has been computed, including the special treatment in 
scenarios (a) - (d), it is applied to a color-coded opacity volume. This was referred to 
with reference to block 1405 in Fig. 14. There are multiple ways known to implement 
this. Often, the color of a voxel is derived from the associated data value, , using a 
color palette, also called a look-up table or LUT, as: 



where LUT is essentially a one-dimensional array of r,g,b,a quadruples indexed by the 
data value, . Thus, whenever a color palette is used, the color of a voxel is a function 
of only the data value. 

When we apply shading to a voxel, the final color of the voxel depends not only 
on the data value, but also on the shading intensity associated with the voxel. The initial 
formula calls for multiplication of each of the color components of each voxel by the 
shading intensity for the voxel. This requires many additional computations, slowing the 
process. One could alternatively use an extended color palette, SHADING_LUT, which 
is a two dimensional matrix composed of r,g,b,a columns computed for different values 
of shading intensity, /.^^^^ . Once pre-computed, such an extended color palette could 
be used to look-up a color of a shaded voxel using the data value, // , and shading 
intensity, /,^. , as indexes: 



(r,g,b,a)^ SHADING . LUT(ju, l,^^ ) 



21 



Method and Apparatus For Visi 
Inventors: Dmitriy G. Repin & 



«on of 3D Voxel Data Using Lit Opacity Volumes With 
5, Passolt 



The initial coloring (r^g^b) of a 3D seismic opacity volume does not depend on 
the volume opacity and can be specified based on any data values associated with a 
volume (e.g., amplitude, instantaneous frequency, etc.). In order to simulate illumination 
of a voxel by a white light, the color components of voxel material are modified by 
5 multiplying them with the shading intensity: 

(^shaded 9 S shaded 9^shaded 9^) ^ shading^^^ shadingS^J shading^ 9^) 

The results obtained from this calculation are the rendered volumetric data that is used to 
display the 3D seismic information volume on a 2D display device. 

While what has been described hereinabove is the preferred embodiment of the 
invention it will be appreciated by those skilled in the art that numerous changes may be 
made without departing from the spirit and scope of the invention. 

What is claimed is: 
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